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Abstract 

Background: The Beck Cognitive Insight Scale (BCIS) was designed for the assessment of the cognitive processes 
involved in self-reflection and the ability to modify erroneous beliefs and misinterpretations. Studies investigating 
the factor structure of the BCIS have indicated a two-factor model in the psychotic population. The factor structure 
of the BCIS, however, has not received much consideration in the nonpsychiatric population. The present study 
examined the factor structure and validity of the BCIS and compared its scores between nonpsychiatric individuals 
and outpatients with psychosis. 

Method: The Taiwanese version of the BCIS was administered to 507 nonpsychiatric individuals and 1 1 8 
outpatients with schizophrenia. The psychometric properties of the BCIS were examined through the following 
analyses: exploratory and confirmatory factor analyses, reliability, correlation analyses, and discriminative validity. 

Results: The BCIS showed adequate internal consistency and stability over time. Exploratory and confirmatory 
factor analyses on the 15-item measure indicated a two-factor solution that supported the two dimensions of the 
Taiwanese BCIS, which was also observed with the original BCIS. Following the construct validation, we obtained a 
composite index (self-reflectiveness minus self-certainty) of the Taiwanese BCIS that reflected cognitive insight. 
Consistent with previous studies, our results indicated that psychosis is associated with low self-reflectiveness and 
high self-certainty, which possibly reflect lower cognitive insight. Our results also showed that better cognitive 
insight is related to worse depression in patients with schizophrenia spectrum disorders, but not in nonpsychiatric 
individuals. The receiver operating characteristic (ROC) analyses revealed that the area under the curve (AUC) was 
0.731. A composite index of 3 was a good limit, with a sensitivity of 87% and a specificity of 51%. 

Conclusion: The BCIS proved to be useful for measuring cognitive insight in Taiwanese nonpsychiatric and 
psychotic populations. 
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Background 

Individuals who are diagnosed with schizophrenia fre- 
quently disagree with mental health professionals 
regarding the nature of their experiences and whether 
they are in need of psychiatric treatment, such as medi- 
cation [1,2]. This phenomenon, which is often referred 
to as "lack of awareness" or "poor insight," has been 



* Correspondence: yiaping@ms75. hinet.net 

department of Physiology, National Defense Medical Center, Taipei, Taiwan 
Full list of author information is available at the end of the article 



linked to poor medication compliance [3,4] and clinical 
outcome [3-5]. A number of etiological models, such as 
the psychological defense [4,6,7], clinical [4,8], and neu- 
ropsychological [3,4,6,9] models, have been proposed to 
explain the poor clinical insight in schizophrenia. 

Neuropsychological impairment has been suggested as 
a central factor underlining poor insight. Poor insight is 
associated with a secondary deficit in neurocognition 
due to structural [10-12] and/or functional brain deficits 
[4,13], especially frontal or parietal dysfunction [14,15]. 
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Aleman et al. (2006) [9] have demonstrated that poor 
insight is associated with poor functioning in a range of 
cognitive domains, including intelligence quotient (IQ), 
memory, and the set-shifting and error-monitoring 
aspects of executive function. Several studies have also 
noted that metacognition has the potential to influence 
insight in individuals with schizophrenia [16-18]. The 
term "metacognition" was first coined by Semerari et al 
[19], and is defined as the "general capacity to think 
about thinking" [19,20]. Of note, metacognition is con- 
sidered to concern a wide range of internally and 
socially driven cognitive acts [19,21]. Through metacog- 
nition, individuals not only process information that 
they encounter, but they can also react to and think 
about their own mental states and those of others 
[19,21]. Specifically, there is growing evidence [17,18] 
that metacognition is not only one of many clinical or 
psychological variables linked to insight in schizophre- 
nia, but metacognition is also a factor that moderate the 
effects of other factors such as self-reflectivity (the abil- 
ity to comprehend one's own mental state) [17-19,21,22] 
and mastery (the ability to form knowledge about one's 
own mental states and those of others and to use that 
knowledge to response to psychological challenges) 
[17-19,23] that underline an individual's awareness of ill- 
ness. Lysaker et al. (2011) [18], for instance, suggested 
that metacognitive abilities, rated by the Metacognition 
Assessment Scale [19], may be linked to insight in indi- 
viduals with schizophrenia independent of concurrent 
impairments in neurocognition. Thus, poor insight in 
schizophrenia may result in part from deficits in meta- 
cognitive capacities, namely self-reflectivity and mastery. 

According to Beck et al. (2004), an important exten- 
sion of the insight concept was introduced with the 
description of "cognitive insight," which was defined as 
a patient's current capacity to evaluate his or her anom- 
alous experiences and atypical interpretations of events 
[24,25]. Those authors provided a conceptual dissocia- 
tion between clinical and cognitive insight, suggesting 
that cognitive insight is a form of cognitive flexibility 
that involves first an ability to distance oneself from dis- 
torted beliefs and misinterpretations and then to reap- 
praise these beliefs and recognize erroneous conclusions 
[24,25]. In a more specific way, at least four aspects of 
cognitive insight can be influenced by psychosis, accord- 
ing to Beck and Warman's research [25]: (a) impairment 
of the ability to be objective concerning delusional 
experiences and cognitive distortions, (b) reduced capa- 
city to put these experiences into perspective, (c) unre- 
sponsiveness to corrective information from others, and 
(d) overconfidence in delusional judgments. Recent find- 
ings have also highlighted the potential importance of 
cognitive insight as a mediator of response to cognitive 
behavioral therapy of psychosis [26]. In fact, Beck's 



theory offered a stronger theoretical basis for cognitive 
insight and supported the contention that it is both 
identifiable and quantifiable [24,25]. Thus, cognitive 
insight was first operationalized with the publication of 
the 15-item Beck Cognitive Insight Scale (BCIS) [24,25]. 

The initial study by Beck et al. showed that the BCIS 
could measure individuals' capacity for distancing them- 
selves from and re-evaluating anomalous beliefs and 
misinterpretations [24,25]. The BCIS, which is a 15-item 
self-report measure, is composed of two subscales: self- 
reflectiveness (SR) and self-certainty (SC) [24,25]. The 
former includes items measuring objectivity, reflective- 
ness, and openness to feedback, and the latter measures 
the certainty of one's beliefs and judgments [24,25]. 
Beck and colleagues proposed that high levels of cer- 
tainty might diminish the capacity for self-reflection; 
thus, a composite index providing an estimate of overall 
cognitive insight was calculated by subtracting the score 
for the SC subscale from the score for the SR subscale 
[24,25]. The two subscale scores were only weakly inter- 
correlated, which indicated that they represent two dif- 
ferent dimensions of cognitive insight [24]. The BCIS in 
this regard proved to be an indirect tool for evaluating 
the impairment of the 'higher level' functions in schizo- 
phrenia, and, more specifically, impairment in the pro- 
cess of distancing oneself from highly salient 
(delusional) beliefs and viewing them in terms of execu- 
tive functions [24,25,27]. 

The majority of studies that have investigated the rela- 
tionship between the overall cognitive insight of schizo- 
phrenia patients (measured by the composite index scale 
of the BCIS) and clinical insight (measured by the Scale 
to Assess Unawareness of Mental Disorder [24,28-30], 
the Positive and Negative Syndrome Scale [29-33], and 
the Birchwood Insight Scale [34]) have found that these 
two variables are significantly related and demonstrate 
convergent and criterion validity, respectively. The relia- 
bility and validity of the BCIS have been demonstrated 
in a mixed group of inpatients with psychosis and 
depression [24,35], groups of inpatients or outpatients 
with schizophrenia spectrum disorders [28,31,34], and a 
group of patients with bipolar disorder [32,35]. The 
BCIS has also been applied to nonclinical populations 
[32,33,36-38] and the internal consistency of the BCIS is 
similar between clinical and nonclinical samples [32,37]. 

A review of the literature indicates that clinical insight 
is associated with depression in patients with psychosis 
[33,39-41]; however, the findings of studies examining 
the relationship between cognitive insight and depres- 
sion have been mixed. Two studies [33,37] found a cor- 
relation between depression as measured by the Beck 
Depression Inventory-II (BDI-II) and cognitive insight in 
patients with schizophrenia or schizoaffective disorder; 
however, another study [24] did not find such a 
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correlation in individuals with psychotic disorders. In 
addition, Pedrelli et al. did not find an association 
between cognitive insight and depression as measured 
by the Hamilton Rating Scale for Depression in middle- 
aged and older patients with schizophrenia and schizoaf- 
fective disorder [34]. However, in an investigation of 
psychotherapy for individuals with schizophrenia or 
schizoaffective disorder, Granholm et al. (2005) [26] dis- 
covered a relationship between increased cognitive 
insight and increased depression midway through the 
treatment. To date, researchers have become increas- 
ingly interested in the relationship between cognitive 
insight and depression in individuals with psychotic dis- 
orders. However, there has thus far been relatively little 
research into this area using a non-psychiatric popula- 
tion sample. Two studies that investigated the BCIS 
with a normal population did not include a measure of 
depression [36,38], which makes it difficult to draw gen- 
eral conclusions about the relationship between cogni- 
tive insight and depression. 

The BCIS has been used for comparisons between 
individuals with a psychotic diagnosis and healthy con- 
trols. One earlier study reported that patients scored sig- 
nificantly higher than controls on SC, but differences in 
SR were not observed between the two groups [37]. In 
another study, Engh et al. (2007) [32] found no differ- 
ence in SR or SC subscales between individuals with 
schizophrenia, those with bipolar disorder, and normal 
controls. However, Martin et al. (2010) [38] found that 
healthy controls exhibited higher SR, lower SC, and a 
higher composite index than patients with schizophre- 
nia. The failure of some previous studies to differentiate 
the SR between patients and controls could be due to a 
high percentage of SR items being omitted by the con- 
trols [32,38], cultural differences in the way individuals 
understand questions on the scale [37,38], and insuffi- 
cient sample size [32,37,38]. At present, high scores on 
the SR subscale and low scores on the SC subscale are 
regarded as being normal [24,25,38,42]. However, this 
theoretical view has not been sufficiently supported by 
direct research to clarify possible impairments in psy- 
chosis and to answer the question as to whether 
increased SR and decreased SC are evidence of improve- 
ment [38]. In addition, cutoff scores that would allow a 
categorical determination of the presence or absence of 
impaired cognitive insight, as measured by the compo- 
site index, have not been clearly determined. In light of 
these concerns, the present study investigated the psy- 
chometric properties and factor structure of the BCIS 
with a large nonpsychiatric population and compared 
the results to those collected from individuals with 
schizophrenia. 

Researchers and clinicians have expanded upon Beck's 
original work with numerous studies focusing on the 



extent to which the construct of the BCIS contributes to 
our understanding of a wider range of cognitive insight. 
To date, the BCIS has already been translated into sev- 
eral languages, including Turkish [28], French [31], Nor- 
wegian [32], Japanese [33], Spanish [43], Korean [44], 
Chinese [45], and Taiwanese [46], and its validity and 
psychometric properties have been reported in each of 
these languages. Research focusing on the discriminative 
properties of the BCIS (i.e., thresholds that draw on the 
combination of sensitivity and specificity) is scarce, how- 
ever. To date, only one study has reported that the com- 
posite index reliably discriminates between outpatients 
and nonpsychiatric individuals (i.e., AUC, 0.641; SE, 
0.033; 95% Confidence interval (95% CI), 0.575-0.707; 
nonparametric P < 0.001) [38]. Visual inspection of the 
ROC curve suggested that no single part of the curve 
maximizes specificity and sensitivity [38]. 

Although a growing number of researchers have con- 
sidered the potential of using self-report scales in cogni- 
tive insight assessments, very little attention has been 
given to the influence of cultural background on Taiwa- 
nese individuals' particular beliefs regarding cognitive 
insight. The extent to which the two-factor model of 
Beck et al. [24,25] can be generalized to our nonpsychia- 
tric population is unclear. Therefore, the aim of the pre- 
sent study was threefold. The first purpose was to 
provide reference data for the BCIS, i.e., examine its 
reliability and validity in a large sample of individuals 
with or without psychiatric diagnoses in Taiwan. We 
predicted that the factor structure of the Taiwanese ver- 
sion of the BCIS would be similar to the findings of the 
studies by Beck et al. (2004) [24,25] and Pedrelli et al. 
(2004) [34]. Based on the factor analyses of the BCIS 
that we performed on data from a nonpsychiatric popu- 
lation, we make recommendations as to how the BCIS 
should be scored and interpreted, and we also explore 
the ability of the BCIS to discriminate between partici- 
pants with and without psychosis. In view of the results 
from earlier studies [33,37,38], we hypothesized that 
individuals with schizophrenia would have less total cog- 
nitive insight than nonpsychiatric individuals. To 
address the previously outlined issues and to begin to 
fill in the gaps of previous research, the second purpose 
of the present study was to investigate the role of 
depression in cognitive insight, looking at nonpsychiatric 
and psychotic populations. The final purpose of the pre- 
sent study was to present additional statistical support 
for the BCIS, using a ROC curve analysis [47]. 

Method 

Participants 

This study was performed in accordance with the latest 
version of the Declaration of Helsinki. Prior to commen- 
cing this study, its performance approval was obtained 
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from the local Research Ethics Committee. Following a 
comprehensive explanation of this study, informed con- 
sent was obtained from all of participants. Participation 
in the present study was strictly voluntary and 
anonymous. 

Two groups of participants were studied. A total of 
130 Taiwanese outpatients (58 males, 72 females) were 
recruited from one psychiatric outpatient department of 
a general hospital located in Taipei, a city in the North 
of Taiwan. Outpatients were diagnosed based on a 
Structured Clinical Interview for Diagnostic and Statisti- 
cal Manual of Mental Disorders (Fourth Edition) [48] 
for at least two years and verified by evaluations that 
were conducted by at least two independent evaluators 
after at least six months of continuous observation. 
Patients who showed evidence of mental retardation (i. 
e., a Mini-Mental State Examination score < 23, which 
indicated disorientation or cognitive impairment to an 
extent that could interfere with the extensive clinical 
assessment [49]) or organic brain pathology, including 
cerebral tumor, epilepsy, systemic disease, history of cra- 
nial trauma, brain surgery, or history of substance abuse 
or dependence in the past or present, were excluded 
from the study. Of the 130 patients initially invited to 
participate in the study, twelve (4 males, 8 females) 
patients did not complete the cognitive insight question- 
naire, which left a pool of 118 participants (54 males, 64 
females) who were available for analyses (91% of the 
initial sample). Of the 118 patients, 76 were diagnosed 
with schizophrenia and 42 with schizoaffective disorder. 
The mean age and formal education of the patients 
were 39.27 years (SD, 9.86; range, 20-59) and 12.64 
years (SD, 2.52; range, 9-18), respectively. The mean age 
of illness onset was 24.39 years (SD, 7.06; range, 15-43), 
the mean illness duration was 15.02 years (SD, 9.51; 
range, 3-37), and the patients had an average of 7.11 
lifetime psychiatric hospitalizations (SD, 4.73; range, 2- 
25). Prior to entering the study, all patients received aty- 
pical antipsychotic medications. 

We preferred nonpsychiatric participants with the 
same-gender who lived in the same residential area as 
each patient to avoid the sociocultural bias: 38 indivi- 
duals refused to participate in the study, which yielded a 
total final sample of 507 nonpsychiatric controls (93% of 
the initial sample) to serve as a general population com- 
parison group (231 males and 276 females; age range 
18-65 years; mean age, 35.08 years; SD, 10.87). The 
mean formal education for individuals in the control 
group was 15.21 years (SD, 2.17; range, 9-22). Only parti- 
cipants who denied having received a formal diagnosis 
of a mental illness and/or a formal specific treatment 
for a mental illness and did not have a history of either 
neurologic impairment or substance abuse were 
selected. 



Baseline demographic data consisted of gender, age, 
marital status (e.g., unmarried, married, divorced), reli- 
gious beliefs (e.g., nonreligious, Buddhism, Taoism, 
Christianity, Catholicism) and formal educational attain- 
ment. A semistructured interview to determine the age 
of illness onset, the duration of illness, and recurrence 
of lifetime psychiatric hospitalizations was obtained 
from the responsible psychiatrist. Data were also 
extracted from all available information, including hos- 
pital records and information from family members. 
The age of illness onset was defined as the age when 
the patient met DSM-IV criteria [48] for the first time. 
The duration of the illness was defined as the time since 
the first psychotic episode. Sociodemographic character- 
istics for all participants are presented in Table 1. The 
repeated measures Chi-square and Student's t tests 
showed that the two groups differed significantly in age 
(t = 3.84), educational attainment (t = -10.27), marital 
status (x 2 = 61.36), and religious beliefs {j 1 = 29.36) 
were detected (P < 0.01 for all variables). 



Table 1 Sociodemographic and clinical characteristics of 
participants (n = 625) 



Nonpsychiatric group Psychotic group 
(n = 507) (n = 118) 



Variables 


n 


% 


n 


% 


Gender 










Male 


231 


45.4 


54 


45.7 


Female 


276 


54.6 


64 


54.3 


Age 










18-29 


172 


33.9 


19 


16.1 


30-39 


203 


40.0 


48 


40.7 


40-49 


71 


14.0 


24 


20.3 


50-59 


-12 


8.4 


27 


22.9 


60-69 


19 


3.7 


0 


0 


Marital status 










Unmarried/single 


271 


53.4 


106 


89.8 


Married 


221 


43.6 


6 


5.1 


Divorced 


15 


3.0 


6 


5.1 


Religion 










None 


265 


52.3 


47 


39.8 


Buddhism 


148 


29.2 


58 


49.2 


Taoism 


65 


12.8 


5 


4.2 


Christianity 


29 


5.7 


5 


4.2 


Catholicism 


0 


0 


3 


2.5 




Mean 
(SD) 


Range 


Mean 
(SD) 


Range 


Age (yr) 


35.08 
(10.87) 


18-65 


39.27 
(9.86) 


20-59 


Education (yr) 


15.21 
(2.17) 


9-22 


12.64 
(2.52) 


9-18 


Average BDI-II 
scores 


4.83 

(7.13) 


0-36 


19.69 
(14.97) 


2-57 



Kao et al. BMC Psychiatry 201 1, 1 1:1 70 
http://www.biomedcentral.eom/1 471 -244X/1 1/170 



Page 5 of 14 



To identify the test-retest reliability of the Taiwanese 
BCIS measure in this study, 100 participants, including 
50 from each diagnostic group, completed the Taiwa- 
nese BCIS again four weeks after the initial assessment. 
All 50 outpatients were closely followed up with the 
same investigator during the time between assessments, 
which permitted a longer interval to complete the test- 
retest procedure. 

Measurements 

Taiwanese version of the Beck Cognitive Insight Scale 

The BCIS [24,25] is a standardized self-rated instrument 
that is composed of 15 items that measure cognitive 
insight. Kao et al. (2010) [46] previously administrated a 
Taiwanese validated version of the BCIS, which was 
translated into Taiwanese and back translated into Eng- 
lish for semantic congruence. The Taiwanese BCIS con- 
sists of two subscales, reflective attitude (9 items) and 
certain attitude (6 items) [46], which are different from 
the original BCIS. Evidence of initial reliability and 
validity has been reported elsewhere [46]. 
Beck Depression Inventory II 

Because the impact of depression on cognitive insight in 
nonclinical and clinical samples is unknown, measures 
assessing depression were included to control for a 
potential between-group effect. Thus, the Beck Depres- 
sion Inventory II (BDI-II) was administered. This scale 
consists of a 21-item self-report scale [50], and each 
item consists of four alternative statements that reflect 
gradations in the intensity of a particular depressive 
symptom (rated in terms of severity from 0 to 3). The 
resulting scores are summed to obtain a total depression 
score (range, 0-63). The BDI-II showed generally accep- 
table internal consistencies in the present study (alpha, 
0.95 for the nonpsychiatric group and 0.90 for the psy- 
chotic group). 

Statistical analysis 

All statistical tests were performed using the Statistical 
Package for the Social Sciences (SPSS) version 15.0 and 
Analysis of Moment Structures (AMOS) version 19.0 for 
Windows (SPSS Inc., Chicago, IL, USA). P values of 0.05 
or less were taken to indicate the statistical significance 
of the two-tailed test results. 

After the administration of the Taiwanese BCIS to the 
nonpsychiatric (n = 507) controls, we used the explora- 
tory factor analysis (EFA) method to extract factors. The 
number of factors was determined by an examination of 
scree plots and the size of eigenvalues. An orthogonal 
(varimax) rotation was made to achieve a more readily 
interpretable factor structure. We extracted factors with 
eigenvalues greater than or equal to 1.0 during the 
exploratory phase of the study. In addition, we chose 0.4 
as a cutoff for the size of loading to be interpreted [51]. 



Correction analyses and the test-retest procedure for 
temporal stability assessment were performed using 
Pearson product-moment correlation coefficients. Inter- 
nal consistency of each subscale resulting from the EFA 
was determined with Cronbach's alpha values, and the 
accepted level was set at 0.7 [51]. 

Confirmatory factor analyses (CFA) were conducted to 
test the hypothesized factorial structure of the Taiwa- 
nese BCIS. The sample size and the number of partici- 
pants for each observable variables were sufficient for 
conducting CFA, and we followed the recommendations 
of Anderson and Gerbing (1984) [52], Bentler and Chou 
(1987) [53], and Garson (2007) [54]. Following the 
recommendations of Beck et al. (2004) [24,25], Pedrelli 
et al. (2004) [34], Uchida et al. (2009) [33], and Martin 
et al. (2010) [38], the items for the cognitive insight 
scale were divided into two "parcels" to produce more 
robust estimates. Therefore, four models with 15 items 
each were specified in the present study. The first 
model (Model 1) was a one-factor model, which sug- 
gested a single cognitive insight factor for grouping all 
15 items. The second model (Model 2) was based on 
the results of the EFA in the present study. The third 
model (Model 3) was the original two-factor model pro- 
posed by Beck et al. (2004) [24,25], Pedrelli et al. (2004) 
[34], Uchida et al. (2009) [33], and Martin et al. (2010) 
[38], which included a nine-item subscale representing 
self-reflectiveness and a six-item subscale representing 
self-certainty. The fourth model (Model 4) was a two- 
factor model that was recently hypothesized by Kao et 
al. (2010) [46]. Nine items represented a reflective atti- 
tude factor and six items represented a certainty factor. 
AMOS 19 was used to perform the CFA for each of the 
four models in the nonpsychiatric (n = 507) and psycho- 
tic (n = 118) groups separately. In the present study, 
model fit was evaluated based on several goodness of fit 
indices, including the goodness of fit index (GFI), 
adjusted GFI (AGFI), non-normed fit index (NNFI), 
comparative fit index (CFI), Tucker-Lewis index (TLI), 
root mean square error of approximation (RMSEA), and 
the Chi-square statistic. Because the Chi-square test is 
sensitive to sample size, other fit indices were consid- 
ered [55,56]. An adequate fit of the model to the data is 
generally indicated by values of > 0.9 for GFI, AGFI, 
NNFI, CFI, and TLI; values of < 0.08 for RMSEA; and 
nonsignificant chi-square statistics (P > 0.05), which 
indicate a lack of differences between the predicted and 
actual models [55,56]. 

Correlation analyses were conducted to determine the 
relationship between the BCIS and the BDI-II scores in 
the two groups. Student's t tests and one-way analyses 
of variance (ANOVA), when appropriate, were used to 
determine whether clinical variables were significantly 
different between the subgroups of participants. 
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Student's t tests were performed to ensure that the BCIS 
subscales and index scores would differentiate between 
psychotic outpatients (n = 118) and nonpsychiatric con- 
trols (n = 507). To evaluate the impact of the clinical 
variables on cognitive insight independent of sociode- 
mographic variables, we conducted analyses of covar- 
iance (ANCOVA) in which the BCIS subscales and 
index scores were dependent variables, the groups were 
independent variable, and age, education, marital status, 
and religion were covariates (concomitant variables). In 
addition, we also conducted an ANCOVA to test 
whether cognitive insight was associated with psychiatric 
diagnoses independent of depressive symptom severity 
(i.e., the subscales and index scores were dependent 
variables, group were the independent variables, and 
depression was the covariate). 

To explore the discriminatory power of the Taiwanese 
BCIS, ROC analyses were utilized to evaluate overall 
performance (i.e., the area under the curve) and the per- 
formance at the optimal thresholds (sensitivity and spe- 
cificity) of the Taiwanese BCIS scale. Furthermore, 
Youden's index [57], which assesses the maximum 
potential effectiveness of a test, was calculated to deter- 
mine which cutoff points on the BCIS maximized both 
sensitivity and specificity. Youden's index is calculated 
by subtracting one from the sum of a test's sensitivity 
and specificity (i.e., the value is expressed as a part of a 
whole number rather than a percentage and maxium 
(sensitivity + specificity) - 1) [58,59]. The area under the 
curve (AUC) of the ROC represents the diagnostic effi- 
ciency of a given measurement based on the method 
developed by Hanley and McNeil (1982) [60]. Because 
this study was designed to provide practical thresholds 
that could serve as clinical markers with acceptable dis- 
criminability, we focused on the thresholds that were 
obtained when the AUC was 0.7 or above [61]. ROC 
analyses were performed using MedCalc for Windows, 
Version 9.2.1.0 (MedCalc Software, Mariakerke, 
Belgium). 

Results 

Construct validity and reliability of the Taiwanese BCIS 

Prior to the EFA, the Kaiser-Meyer-Olkin measure of 
sampling adequacy was at an acceptable level of 0.75, 
and Bartlett's test of sphericity was significant (1485.06, 
P < 0.001), which indicated the adequacy of the data for 
applying the EFA. According to the EFA with varimax 
rotation, the first two eigenvalues were 3.14 and 2.37, 
which accounted for 39.5% of the total variance. These 
eigenvalues indicated that two factors should be 
extracted and inspected for simple structure. 

Each of the subscales was developed based on the fac- 
tor loadings and applied in the subsequent analyses. For 
each item, the highest factor loading determined the 



subscale inclusion. The two subscales that were indi- 
cated by the analyses can most suitably be described as 
the SR subscale and the SC subscale (Table 2). Based on 
concepts regarding self-correction that were derived 
from previous studies [21,22,30,31,35], a composite 
index was calculated (i.e., SR minus SC) as the measure 
of cognitive insight in this study. 

The results of CFA for the four models of the factor 
structure of the BCIS in the Taiwanese populations are 
shown in Table 3. Model 2 and Model 3 adequately ful- 
filled the criteria for good fit in the nonpsychiatric and 
psychotic groups, whether the other factorial models (i. 
e. GFI, AGFI, NNFI, CFI, and TLI) had values below the 
recommended threshold of 0.9 or RMSEA had a value 
above 0.08. We therefore concluded that the CFA 
demonstrated superiority of the original two-factor 
model, and proceeded to assess the internal consistency 
reliability of subscales calculated from sum scores cre- 
ated by summing the items loading on a given factor. 

Internal consistency analyses were conducted on each 
of the two subscales, and the reliabilities (coefficient 
alpha) of the two subscales of the Taiwanese BCIS for 
the 507 controls were 0.75 for the SR and 0.78 for the 
SC. In addition, the alpha coefficients for the SR and SC 
were 0.72 and 0.68, respectively, for the 118 outpatients 
with schizophrenia or schizoaffective disorder. The test- 
retest reliability coefficient over a four-week interval 
ranged from 0.75 to 0.78 for the subscales and compo- 
site index level in the two groups (P < 0.01 for all 
values). It should be noted, however, that no significant 
correlation was found between the SR and SC scores in 
this study. 

Psychotic disorder and nonpsychiatric control 
comparisons 

Table 4 presents the demographic and clinical charac- 
teristics of the two groups as well as their scores on the 
BCIS according to sociodemographic variables. In the 
nonpsychiatric group, there were no significant differ- 
ences among the BCIS scores with respect to religion. 
Interestingly, women scored higher on both the SR and 
SC compared with men (t = 2.04, P = 0.04; t = 3.7, P < 
0.01, respectively). Moreover, the SC scores were differ- 
ent with regard to age (F (4j 502 ) = 5.81, P < 0.01) and 
marital status (F (2 , 504) = 5.86, P < 0.01). Among partici- 
pants with psychosis, the composite index scores dif- 
fered significantly in terms of age (F (3j 114 ) = 3.78, P = 
0.012). Student's t tests and ANOVA results also indi- 
cated that there were no significant differences in the 
subscales and index scores between sex, marital status, 
or religion (all P > 0.05 in all comparisons) in the psy- 
chotic outpatients. 

To assess the discriminative validity of the Taiwanese 
BCIS, we used Student's t tests to compare the mean 
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Table 2 Factor analysis and reliability of the Taiwanese BCIS 



Item Statement 



test scores of the subscales and the composite index for 
the patients and controls. The results are presented in 
Table 5. Before discussing the potential confounding 
effects of clinical variables with ANCOVA, certain facts 
that were manifested in the patients and controls are 
worth considering. For examples, there was a statistically 
significant difference in the BCIS scores between the psy- 
chotic and healthy control samples. The mean composite 
index scores were significantly higher in the 507 nonpsy- 
chiatric controls than in the outpatients with psychosis (t 
= -8.32; P < 0.01). With regard to the scores for the two 
subscales, the SR scores of the outpatients were lower 
than the scores of the controls (t = -4.44, P < 0.01). The 
SC scores of the outpatients, however, were higher than 
the scores of the controls (t = 3.38, P < 0.01). Adjusting 
for sociodemographic variables such as age, education, 
marital status, and religion in the ANCOVAs did not 
have any significant effects on these results. 

To determine whether depression was related to BCIS 
scores in the two groups, we conducted a series of cor- 
relation analyses. The results indicated that the SR and 
composite index scores were significantly correlated 
with depression in the psychotic group (r = 0.378, P < 
0.01; r = 0.32, P < 0.05, respectively). No other signifi- 
cant effects were observed. For the BDI-II scores, the 
difference between nonpsychiatric (mean = 4.83, SD = 



BCIS a) BCIS b) 
(n = 507) (n = 180) 
Factor Factor 
Subscale I II I II 

06 
69 
0 
09 
.01 
.14 
62 
25 
79 
20 
03 
47 
69 
55 
18 
7.7 
72 



7.13) and psychotic (mean = 19.69, SD = 14.97) groups 
was significant (t = 10.51, P < 0.001). Thus, for the fol- 
lowing analyses, the BDI-II score will be entered as a 
covariate when the dependent variables are examined. 
After controlling for depressive symptoms, significant 
differences remained in the two groups with regard to 
the SR (F (1 , 623) = 20.72, P < 0.001), SC (F (1 , 623) = 
11.29, P < 0.001), and composite index (F ( 1; 62 3) = 
48.39, P < 0.001) (Table 5). 

ROC curve and the AUC 

Diagnostic validity based on the areas under the ROC 
curves and the optimal cutoff points for sensitivity and 
specificity were used to assess the diagnostic validity 
between the psychotic group and the control groups, 
and these data are summarized in Table 6. Based on the 
ROC analyses, the composite index score was able to 
correctly classify participants into the psychosis and 
healthy control groups. The cutoff threshold that discri- 
minated between patients and controls was 3, the sensi- 
tivity was 0.87, and the specificity was 0.51 (AUC, 0.731, 
95% CI, 0.694-0.765, P < 0.001). 

Discussion 

We analyzed the responses to the Taiwanese BCIS of 
507 nonpsychiatric and 118 psychotic participants to 



1 


At times, 1 have misunderstood other's attitudes toward me. 


SR 


0.48 


0.11 


0.50 


0. 


2 


My interpretations of my experiences are definitely right. 


SC 


0.25 


0.48 


0.08 


0. 


3 


Other people can understand the cause of my unusual experiences better than 1 can. 


SR 


0.55 


-0.10 


0.60 


0. 


A 


1 have jumped to conclusions too fast. 


SR 


0.60 


0.09 


0.61 


0. 


5 


Some of my experiences that have seemed very real may have been due to my imagination. 


SR 


0.62 


0.24 


0.76 


-0 


6 


Some of the ideas 1 was certain were true turned out to be false. 


SR 


0.58 


0.14 


0.62 


-0 


7 


If something feels right, it means that it is right. 


SC 


0.16 


0.52 


0.12 


0. 


8 


Even though 1 feel strongly that 1 am right, 1 could be wrong. 


SR 


0.42 


-0.24 


0.31 


0. 


9 


1 know better than anyone else what my problems are 


SC 


0.03 


0.65 


0.05 


0. 


10 


When people disagree with me, they are generally wrong. 


SC 


0.02 


0.59 


0.49 


0. 


1 1 


cannot trust other people's opinion about my experiences. 


SC 


-0.13 


0.66 


0.55 


0. 


12 


If somebody points out that my beliefs are wrong, 1 am willing to consider it. 


SR 


0.50 


-0.22 


-0.01 


0. 


13 


1 can trust my own judgments at all times. 


SC 


0.07 


0.69 


0.07 


0. 


1-1 


There is often more than one possible explanation for why people act the way they do. 


SR 


0.54 


-0.25 


0.04 


0. 


15 


My unusual experiences may be due to my being extremely upset or stressed. 


SR 


0.46 


0.07 


0.34 


0. 




% of Variance 




22.0 


17.5 


28.3 


i: 




Cronbach's alpha coefficient 




0.75 


0.78 


0.7 


0. 



Note: Extraction with Rotation method: principal component analysis with Varimax 
SR indicated Self-reflectiveness subscale; SC, Self-certainty subscale. 

a) : Translated Taiwanese version of the Beck Cognitive Insight Scale, administered to Taiwanese 508 nonpsychiatric controls. 

b) : Translated Taiwanese version of the Beck Cognitive Insight Scale, administered to native Taiwanese 60 outpatients with schizophrenia, 60 outpatients with 
major depressive disorders, and 60 nonpsychiatric controls. 
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Table 3 Confirmatory factor analysis for four models of 
factor structure of the Taiwanese BCIS in two groups 



(n = 625) 

Fit indices 

Models x 2 GFI AGFI NNFI CFI TLI RMSEA 

(df) (90%CI) 

Factor structure for the nonpsychiatric group (n = 507) 

Model 1 371.84 0.72 0.69 0.71 0.69 0.69 0.14 

(90) (0.136-0.144) 

Model 2 296.57 0.94 0.91 0.89 0.92 0.91 0.058 

(89) (0.052-0.064) 

Model 3 296.57 0.94 0.91 0.89 0.92 0.91 0.058 

(89) (0.052-0.064) 

Model 4 335.57 0.83 0.80 0.79 0.81 0.80 0.091 

(89) (0.083-0.099) 

Factor structure for the psychotic group (n = 118) 

Model 1 241.42 0.69 0.61 0.67 0.68 0.66 0.158 

(90) (0.152-0.164) 

Model 2 162.07 0.91 0.90 0.88 0.89 0.90 0.071 

(89) (0.062-0.08) 

Model 3 162.07 0.91 0.90 0.88 0.89 0.90 0.071 

(89) (0.062-0.08) 

Model 4 213.13 0.80 0.73 0.78 0.81 0.77 0.099 

(89) (0.092-0.106) 

Criteria 3 n.s. > 0.9 > 0.9 > 0.9 > 0.9 > 0.9 < 0.08 



*P < 0.05; **P < 0.01 

Note: Model 1 indicated one-factor (unidimensional); Model 2, two-factor 
based on the results of EFA in this study; Model 3, two-factor based on the 
original BCIS studies; Model 4, two-factor based on the Kao et al. study (2010). 
Abbreviations: GFI, Goodness of Fit Index; AGFI, Adjusted Goodness of Fit 
Index; NNFI, Non-normed Fit Index; CFI, Comparative Fit Index; TLI, Tucker- 
Lewis index; RMSEA 90% CI, Root Mean Square Error of Approximation 90% 
confidence interval; n.s., non-significant (P > 0.05). 
a Adapted from Petersens (2009); Hoyle and Panter (1993) 

investigate whether the existing factor structures fit the 
data. We also examined the psychometric characteristics 
of the Taiwanese BCIS. Our results broadly supported 
the majority of the findings in literature, which have 
indicated that the multidomain structure of the Taiwa- 
nese BCIS is robust, the two-factor model is the optimal 
representation of the relationship between the items 
measuring cognitive insight, and the psychometric char- 
acteristics of the Taiwanese BCIS are adequate for both 
nonpsychiatric and psychotic populations. Furthermore, 
this study provided the first evidence of cross-cultural 
validity of the cognitive insight construct in a Taiwa- 
nese-speaking context and it supported the use of the 
BCIS in cross-cultural research. 

Two factors, SR and SC, emerged in exploratory factor 
analyses using principal axis factoring and varimax rota- 
tion; the two factors accounted for 39.5% of the var- 
iance. Interestingly, the two factors were the same as 
the factors determined by Beck et al. in the original 
BCIS [24] in a sample of inpatients with schizophrenia, 
schizoaffective disorder, or mood disorder; however, the 



factors differed from a study by Kao et al. (2010) [46], 
conducted in samples of patients with schizophrenia, 
schizoaffective disorder, major depressive disorder with- 
out psychotic features, and healthy controls. The present 
findings were also consistent with a previous study by 
Martin et al. (2010) [38], which confirmed that the basic 
factor structure and internal consistency of the BCIS 
were similar for the normal population. Recently, 
Uchida et al. (2009) [33] also observed acceptable inter- 
nal consistency of the BCIS in a sample of nonpsychia- 
tric Japanese individuals. These findings support the 
generalizability of the two-factor model of cognitive 
insight to both nonpsychiatric and psychotic popula- 
tions. The test-retest reliability intraclass coefficients of 
the Taiwanese BCIS confirmed the stability of cognitive 
insight in nonpsychiatric and psychotic populations, 
thus indicating the reliability of the Taiwanese BCIS. 

The alpha coefficient values for the SR and SC subscale 
scores in the nonpsychiatric group were 0.75 and 0.78, 
respectively, and these values indicated that the internal 
consistencies of the Taiwanese BCIS subscales were ade- 
quate for research purposes. Moreover, the present sam- 
ple's alpha coefficients for outpatients who had been 
stabilized in an outpatient setting were higher than the 
alpha coefficients (0.68 for SR and 0.60 for SC) that Beck 
et al. [24] found for their acute sample. These latter alpha 
coefficients, however, are similar in magnitude to those 
reported by Pedrelli et al. (2004) [34] (i.e., 0.7 for SR and 
0.55 for SC) for 164 middle-aged and older outpatients 
diagnosed with either schizophrenia or a schizoaffective 
disorder. A partial explanation for the inconsistent results 
may lie in the fact that these low coefficients alpha are 
partially attributed to the severity of the patients' current 
symptoms, especially for those patients with thought dis- 
turbances and concentration difficulties [24] . In the psy- 
chotic group, the alpha coefficient for the SC scores was 
< 0.7, but this value was considered acceptable for the 
present research purpose because these subscales were 
composed of fewer that ten items [24,62,63]. 

To our knowledge, this is the largest population-based 
examination of the factor structure of the BCIS. Testing 
for multiple a priori models and indices has established 
that the BCIS has acceptable validity and reliability in 
both nonpsychiatric and psychotic samples. Consistent 
with the multidimensional view of cognitive insight, the 
CFAs supported a two-factor structure underlying the 
BCIS in non-psychiatric and psychotic populations. 
Most of GFI statistics performed better with GFI, AGFI, 
TLI, and RMSEA. However, two of them (CFI, NNFI) 
are slightly lower than the cut off previously recom- 
mended [55,56] and could be considered as acceptable. 
In CFA, previous studies have used the ratio % 2 /df as 
an index to assess the consistency of different models' 
factor structure. Having % /df < 2 means that the 
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Table 4 Distribution of scores on the Taiwanese BCIS among the samples (n = 625) 







Nonpsychiatric group 




Psychotic group 








(n = 507) 






(n = 118) 






SR 


SC 


Composite index 


SR 


SC Composite index 




Mean 


Mean 


Mean 


Mean 


Mean 


Mean 




(SD) 


(SD) 


(SD) 


(SD) 


(SD) 


(SD) 


Gender 














Male 


1441 


8.42 


5.99 


11.93 


8.98 


2.94 




(342) 


(9 41) 




(4.91) 


(3.83) 


(4.61) 


Female 


1 J.OZ 


7.60 


6.2 1 


1 1 

i zjy 


9.25 


3.14 




(3.1 0) 


(1 ^Q) 




(3.93) 


(3.22) 


(3.43) 


t 


1 DA 


3.7 


-0.72 


U.jO 


0.41 


0.26 


p 


0.04* 


< 0.01** 


> 0.05 


> 0.05 


> 0.05 


> 0.05 


Age 














18-29 


14.16 


7.54 


6.62 


11.26 


8 16 


A 1 1 




(2.95) 


(2.35) 


(3.38) 


(3.84) 


(2.61) 


(2.64) 


30-39 


13.68 


7.80 


5.88 


11.38 


9.60 


1.77 




(3.13) 


(2.70) 


(3.33) 


(4.82) 


(4.05) 


(3.45) 


40-49 


14.63 


8.56 


6.07 


13.04 


9.46 






(3.44) 




(3 87) 


(3.41) 


(2.98) 


3.58 














(381) 


50-59 


14.45 


8 80 




13.48 


8.67 






(3.74) 


(1.95) 


(4.06) 


(4.48) 


(3 40) 


4.81 














(5.11) 


60-69 


14.84 


9.63 


5.21 


0 


0 


0 




(4.95) 


(2.79) 


(3.77) 


0 


0 


0 


F 


1.69 


5.81 


1.63 


1.96 


1.01 


3.78 


P 


> 0.05 


< 0.01** 


> 0.05 


> 0.05 


> 0.05 


0.012* 


Marital status 














Unmarried/single 


14.06 


7.61 


6.45 


12.27 


9.12 


3.08 




(3.05) 


(2.56) 


(3.29) 


(4.44) 


(3.58) 


(4.03) 


Married 


14.09 


8.39 


5.70 


12.0 


9.50 


2.50 




(3.54) 


(2.46) 


(3.66) 


(1.67) 


(2.74) 


(1 .97) 


Divorced 


14.53 


9.27 


6.27 


10.67 


7.50 


3.17 




(2.77) 


(2.43) 


(4.71) 


(5.61) 


(2.59) 


(5.19) 


F 


0.147 


5.86 


2.80 


0.381 


0.701 


0.061 


P 


> 0.05 


< 0 01 ** 


n 

u.uoz 


> 0.05 


s no 1 : 

s U.UJ 


> 0 05 


Religion 














None 


14.24 


7.98 


6.26 


12.32 


8.78 


2.53 




(3.29) 


(2.71) 


(3.40) 


(4.49) 


(3.43) 


(4.46) 


Buddhism 


13.89 


7.99 


5.90 


11.88 


9.29 


2.59 




(3.36) 


(2.35) 


(3.76) 


(4.66) 


(3.70) 


(3.77) 


Taoism 


13.97 


7.90 


6.06 


14.6 


11.0 


3.60 




(3.10) 


(2.20) 


(3.34) 


(3.21) 


(2.65) 


(2.88) 


Christianity 


13.93 


7.93 


6.00 


11.8 


8.20 


3.60 




(2.90) 


(2.63) 


(3.71) 


(1.30) 


(3.63) 


(3.91) 


Catholicism 


0 


0 


0 


12.33 


9.67 


2.67 




0 


0 


0 


(2.08) 


(1.15) 


(3.21) 


F 


0.424 


0.021 


0.352 


0.461 


0.599 


0.413 


P 


> 0.05 


> 0.05 


> 0.05 


> 0.05 


> 0.05 


> 0.05 



*P < 0.05; **P < 0.01 



model fits well, but it is important to note that the lar- 
ger the sample size, the bigger the j 2 [64]. Because of 
the large sample size (n = 507) in the present study, it 
might not be appropriate to use j 2 /df as the index to 
assess the fit of the model. 



The present findings add to the previous studies [38] 
that have suggested that participants with psychosis 
have impaired SR when compared with healthy controls. 
A partial explanation for this may lie in the fact that 
deficits in metacognition are a stable feature of 
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Table 5 Descriptive statistics for nonpsychiatric control 
and psychotic outpatient groups and the results of an 
ANCOVA with depressive symptoms scores as a covariate 
showing differences between the two groups 

Controls Outpatients 
(n = 507) (n = 118) 

Mean Range Mean Range t-test ANCOVA 





(SD) 




(SD) 


F(1,623) 


SR 


14.09 


4-24 


12.18 1-25 -4.44** 


20.72** 




(3.26) 




(4.39) 




SC 


7.97 


0-15 


9.13 1-18 3.38** 


1 1 .29** 




(2.49) 




(3.50) 




Composite index 


6.11 


-5-18 


3.05 -5-18 -8.32** 


48.39** 




(3.50) 




(3.99) 





P < 0.01 



schizophrenia [22] and that such deficits may be key 
features of the relationship between schizophrenia and 
self-reflectivity [17-19,21,22]. Although the same spec- 
trum of cognitive dysfunctions should also be expressed 
in nonpsychiatric individuals, the severity of cognitive 
dysfunction should increase towards the schizophrenia 



end of the continuum. In other words, the core clinical 
and subclinical features of schizophrenia, such as limita- 
tions in the individuals' metacognitive capacity to reflect 
upon their difficulty in thinking as well as to recognize 
and correct their errors, will be found across the dimen- 
sion of cognitive insight [17,18,21,22]. 

Previous studies investigating the relationship between 
cognitive insight and depression have reported conflict- 
ing results. Several studies have replicated the finding of 
Beck et al. [24] that depression was not related to cogni- 
tive insight in patients with a psychotic diagnosis 
[30-32,34]. Three studies [35,37,65], however, found that 
better cognitive insight (composite index and SR) is 
related to worse depression in patients with schizophre- 
nia or schizoaffective disorder when looking at a cross- 
section. Our results replicate earlier findings [35,37,65] 
concerning the association between cognitive insight 
and depression in patients with schizophrenia. The 
results suggest that schizophrenia patients with depres- 
sion have better cognitive insight than those without 
comorbid depression. This finding could be due to the 



Table 6 Sensitivity and specificity at various cutoff points of the Taiwanese BCIS composite index for cognitive insight 

Score threshold Sensitivity Specificity Yuden Index n (%) of patients identified at or below cutoff 

(%) ' (%) 



Schizophrenia (n = 1 18) 



19 


0 


100 


1.00 


118 (100%) 


18 


0 


100 


1.00 


118 (100%) 


17 


0.39 


99.75 


1.00 


1 1 7 (99.2%) 


16 


0.99 


99.15 


1.00 


1 1 7 (99.2%) 


15 


1.78 


99.15 


1.01 


1 1 7 (99.2%) 


M 


2.17 


98.31 


1.00 


1 1 7 (99.2%) 


13 


4.73 


98.31 


1.03 


1 1 6 (98.3%) 


12 


8.48 


98.31 


1.07 


1 1 6 (98.3%) 


11 


10.85 


97.46 


1.08 


1 1 6 (98.3%) 


10 


16.57 


92.37 


1.09 


1 1 5 (97.5%) 


9 


22.88 


88.98 


1.12 


109 (92.45) 


8 


30.97 


85.59 


1.17 


105 (89.0%) 


7 


40.43 


82.2 


1.23 


101 (85.6%) 


6 


54.44 


77.12 


1.32 


97 (82.2%) 


5 


67.26 


66.10 


1.33 


91 (77.1%) 


<1 


77.51 


59.32 


1.37 


78 (66.1%) 


3* 


87.18 


50.85 


1.38 


70 (59.3%) 


2 


92.11 


37.29 


1.29 


60 (50.8%) 


1 


95.86 


29.66 


1.26 


44 (37.3%) 


0 


98.42 


17.80 


1.16 


35 (29.7%) 


-1 


99.0 


10.17 


1.09 


21 (17.8%) 


-2 


99.41 


5.93 


1.05 


12 (10.2%) 


-3 


99.8 


1.69 


1.01 


7 (5.9%) 


--1 


99.8 


0.85 


1.01 


2 (1.7%) 


-5 


99.9 


0.65 


1.01 


1 (0.9%) 


-6 


100 


0 


1 .00 


0 (0%) 



*Optimal cutoff point (maximum sensitivity and specificity) shown in bold. 
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fact that as individuals begin to believe they are mentally 
ill, they are confronted with and demoralized by self- 
stigma [17,45,66-70], which is, in turn, related to poor 
self-esteem [17,45,67-70], depressed mood [17,68], and 
hopelessness [17,68-70]. In empirical studies of this 
hypothesis, previous research has noted that the associa- 
tion of insight with depression [68], low quality of life 
[68], negative self-esteem [68,69], hope [69], and social 
functioning [69] is moderated by self-stigma. A previous 
study also reported that having a greater level of cogni- 
tive insight was significantly associated with experien- 
cing a high level of self-stigma [45]. The increased SR or 
cognitive insight in such individuals can be used to indi- 
cate a negative attitude to self or "bad me" distortions of 
thinking [71,72], given that individuals with depression 
are characterized by a variety of negative biases about 
the self or negative self appraisal [72,73]. It may be of 
interest for future research to examine whether certain 
kinds of psychosocial intervention might be beneficial in 
improving SR or cognitive insight, while decreasing 
rather than increasing depressive symptoms. Further- 
more, the relationships between cognitive insight and 
depression could be studied longitudinally. Unexpect- 
edly, the present study found that depression was not 
significantly correlated with the BCIS index or its sub- 
scales in nonpsychiatric individuals. It is unlikely that 
this was due to a floor effect or a limited range of scores 
on the BDI (see Table 1). Thus, it can be reasoned that 
the relationship of the SR dimension of cognitive insight 
to depression is not driven by a specific cognitive pro- 
cess such as self-reflectivity but rather is related to the 
experience of adopting the stigmatizing label and inter- 
nalizing the stigma. As with unexpected and negative 
findings, future studies are required before any firm 
conclusions can be drawn. 

The area under the ROC curve in the present study 
demonstrated that the Taiwanese BCIS satisfactorily dif- 
ferentiated patients with schizophrenia from the nonpsy- 
chiatric controls. In addition to being useful as an 
outcome measure for assessing responses to cognitive 
insight, the BCIS might be employed as a screening 
instrument to identify patients who are willing to exam- 
ine their erroneous beliefs and accept the types of cor- 
rective feedback afforded by cognitive therapy [26]. 
Colis et al. (2006) also suggested that the BCIS might be 
used to screen for patients who exhibit low levels of 
cognitive insight and require more stabilization with 
psychotropic medications before engaging in psy- 
chotherapy [35]. Therefore, in the present study, our 
goal was to validate use of the BCIS to screen for cogni- 
tive insight in clinical settings where one may want to 
maximize the sensitivity of a test. It is important to note 
that the risks associated with the profound damage of 
psychotic relapses and the difficulties in treating 



psychotic disorders are high. In addition, the costs asso- 
ciated with further assessment of those patients with 
psychosis who appear to be unaware of their illness, 
their need for treatment, and the social consequences of 
psychotic disorder are relatively low. Thus, a screening 
measure of cognitive insight that would identify this 
"high-risk" population would be valuable, providing 
good sensitivity at the cost of some specificity. For this 
reason, we suggested a BCIS index cutoff value of 3 
(sensitivity, 87%; specificity, 51%) for the detection of 
moderate or severe impairments in cognitive insight in a 
Taiwanese population. However, cutoff scores provided 
in this and similar studies largely depend on sample 
characteristics (in particular, sample sizes and types of 
psychiatric disorders or conditions considered in the 
studies) as well as on the procedures used during assess- 
ment, diagnosis, and data analysis. Given the number of 
differences across studies in these and other variables, it 
is difficult to compare the current results with previous 
evidence; cutoff scores provided in this study should 
therefore be treated with caution [74]. 

Several methodological limitations should be consid- 
ered when interpreting these findings. Most importantly, 
the size of the psychotic group was relatively small. Lar- 
ger patient sample sizes would give more precise para- 
meter estimates for CFA. Necessary sample sizes for 
CFA are controversial and require further research [75]. 
The rule of thumb that samples of 100-200 represent a 
"medium" sample size is not absolute because model 
complexity must also be considered [76]. Clearly, a lar- 
ger sample size would provide more power for statistical 
tests. Second, generalizability may be limited given the 
particular sociodemographic characteristics of the study 
sample, which mainly included urban Taiwanese. Third, 
we readily acknowledge that our research was explora- 
tory and that our recruitment procedure could be 
improved. The outpatients who agreed to participate in 
the cognitive insight assessment may have had better 
relationships with the staff, may have more clearly per- 
ceived the beneficial effects of treatment, or may have 
had a higher cognitive insight level than those who did 
not agree to participate. Fourth, in patients diagnosed 
with schizophrenia, deficits of metacognitive capacities 
or neurocognitive impairments are most likely the stron- 
gest predictor of cognitive insight [17,18,21,22] and 
future functional adaptability [19-21,23,77-80]. Deter- 
mining reliable baseline cognitive function, particularly 
at the onset of the first episode of psychosis, may 
improve the predictive ability of these measures. In our 
study, however, cognitive insight assessments for 
patients with multiple relapses were limited due to the 
manifestations of neuropsychological deficits in schizo- 
phrenia spectrum disorders. Finally, none of the psycho- 
tic outpatients who participated in our study were naive 
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to antipsychotics. Indeed, all of the psychotic patients 
took atypical antipsychotics, and none of the patients 
were drug-free at the time of assessment. Specifically, 
studies have shown that atypical antipsychotics improve 
some aspects of cognitive functioning [81,82]. Further 
research in this area would benefit from the investiga- 
tion of the influence of medication effects and neuropsy- 
chological deficits on cognitive insight formation in 
psychosis. 

Conclusions 

Cognitive insight regarding mental illness may deter- 
mine how people seek help for mental health problems 
or if they even seek help at all. Cognitive insight also 
may determine their level of engagement with treatment 
and the outcome of their problems. The usefulness of 
the BCIS in nonclinical and clinical samples was repli- 
cated in a Taiwanese population. This model enables 
the comparisons of the present results with the results 
from the US and other countries in which the same fac- 
tor structure of BCIS items has been applied. The theo- 
retical model underlying the BCIS provides related 
information; therefore, longitudinal studies are also 
recommended to analyze the antecedent-consequence 
relationship between dimensions of the scale in an 
empirical manner. 
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